Making Static Lessons Adaptive through Crowdsourcing & Machine Learning
نویسندگان
چکیده
Text components of digital lessons and problems are often static: they are written once and too often not improved over time. This is true for both large text components like webpages and documents as well as the small components that form the building blocks of courses: explanations, hints, examples, discussion questions/answers, emails, study tips, motivational messages. This represents a missed opportunity, since it should be technologically straightforward to enhance learning by improving text, as instructors get new ideas and data is collected about what helps learning. We describe how instructors can use recent work (Williams, Kim, Rafferty, Maldonado, Gajos, Lasecki, & Heffernan, 2016a) to make text components into adaptive resources that semi-automatically improve over time, by combining crowdsourcing methods from human computer interaction (HCI) with algorithms from statistical machine learning that use data for optimization.
منابع مشابه
Machine Learning and Citizen Science: Opportunities and Challenges of Human-Computer Interaction
Background and Aim: In processing large data, scientists have to perform the tedious task of analyzing hefty bulk of data. Machine learning techniques are a potential solution to this problem. In citizen science, human and artificial intelligence may be unified to facilitate this effort. Considering the ambiguities in machine performance and management of user-generated data, this paper aims to...
متن کاملToward Flexible MOOCs: Student-Sourcing of Learning Content at Scale
A mong the most exciting opportunities heralded by massive open online courses (MOOCs) is their ability to leverage the power of big data. MOOCs allow us to log, at a relatively fine-grain level, the data of thousands of learners taking the same course. Many promises have been made in the media and research literature about how this data might be used to optimize learning. One such promise is d...
متن کاملMaking Better Use of the Crowd
This tutorial provides a comprehensive overview of the landscape of crowdsourcing research, targeted at the machine learning community. We begin with a showcase of innovative uses of crowdsourcing, covering direct applications to machine learning systems, crowdsourcing for hybrid intelligence, and large scale studies of human behavior online. We then dig into recent research aimed at understand...
متن کاملStatistical decision making for optimal budget allocation in crowd labeling
It has become increasingly popular to obtain machine learning labels through commercial crowdsourcing services. The crowdsourcing workers or annotators are paid for each label they provide, but the task requester usually has only a limited amount of the budget. Since the data instances have different levels of labeling difficulty and the workers have different reliability for the labeling task,...
متن کاملMaking Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research
This survey provides a comprehensive overview of the landscape of crowdsourcing research, targeted at the machine learning community. We begin with an overview of the ways in which crowdsourcing can be used to advance machine learning research, focusing on four application areas: 1) data generation, 2) evaluation and debugging of models, 3) hybrid intelligence systems that leverage the compleme...
متن کامل